The Capacity of Multilevel Threshold Functions

The investigation of information capacity and computation power of threshold elements is motivated by the recent trend of neural-network approaches to pattern recognition. In this correspondence, we estimate lower and upper bounds for the capacity of multilevel threshold elements, using two essentially different enumeration techniques. The results correct a previously published estimate and indicate that adding threshold levels enhances the capacity more than adding variables.